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SUMMARY: 


1  . 

Th«  Rock  Island  Arsenal  Operation  Directorate  is  evolving 
into  a  Flexible  Computer  Integrated  Manufacturing  (FCIM) 
facility.  The  FCIM  enhances  production  diversity.  But,  full 
FCIM  benefits  can  only  be  achieved  in  facilities  capable  of 
untended  or  semi -untended  operations.  However,  this  capability 
creates  tool  replacement  problems.  In  a  one-operator-one-machine 
environment  the  operator  is  always  in  the  vicinity  of  the  machine 
and  can  receive  sensory  signals  (aural,  visual,  olfactory,  or 
tactile)  from  a  worn  tool  and  replace  it  before  the  workpiece  is 
damaged.  But,  in  untended  or  semi -untended  operations  the 
operator  might  not  be  in  the  vicinity  to  receive  the  tool's 
signal,  resulting  in  a  ruined  workpiece. 

The  Rock  Island  Arsenal  solution  to  this  problem  is  to 
forecast  tool  life,  monitor  current  tool  age  (inches  drilled, 
workpieces  completed,  tool  lip  wear)  and  when  current  tool  age  is 
within  some  range  of  forecasted  tool  life  the  operator  is 
notified.  The  operator  then  orders  a  replacement  tool  and  has  it 
available  for  immediate  replacesient  when  current  age  equals 
forecasted  tool  life.  This  eliminates  the  possibility  of  the 
tool  wearing  out  and  ruining  the  workpiece  and  it  alleviates  the 
wait  while  a  tool  is  brought  to  the  machine  from  the  tool  crib. 

Implementation  of  this  solution  is  contingent  on  the 
capability  to  forecast  tool  life.  Tool  life  can  be  forecast  in 
millimeters  of  drill  lip  wear,  linear  incaes  of  metal  drllxed,  or 
workpieces  completed.  Tool  lip  wear  is  the  primary  Indicator. 
However,  monitoring  lip  wear  requires  that  either  a  wear  sensor 
be  incorporated  into  the  machine  to  dynamically  steasure  lip  wear 
or  the  wear  has  to  be  manually  measured  after  each  workpiece  is 
completed.  The  first  option  Increases  the  cost  and  complexity  of 
the  machine  and  the  second  option  decreases  productivity.  These 
monitoring  complications  can  be  circumvented  by  forecasting  tool 
life  in  either  total  inches  drilled  or  workpieces  completed,  both 
of  which  are  easy  to  monitor.  Either  variables  can:  (1)  be 
forecasted  directly,  (2)  can  be  derived  by  forecasting  wear  and 
wear  rate  (millimeters  of  wear  per  inch  o..  .uetal  drilled  or 
millimeters  of  wear  per  workpiece)  and  dividing  wear  by  wear 
rate;  or  (3)  can  be  derived  by  choosing  a  constant  wear  value, 
such  as  the  mean  wear  for  all  tested  drills,  and  using  this  value 
in  conjunction  with  a  forecasted  wear  rate  to  forecast  tool  life. 

To  develop  a  forecasting  capability  Rock  Island  Arsenal 
initiated  an  experimental  program  to  gather  the  data  necessary 
for  the  development  of  a  forecasting  method.  The  experiments  are 
being  conducted  by  Dr.  J.  L.  Moriarty  --of  the  Rock  Island 
Arsenal  Science  and  Engineering  Directorate.  The  set  of 
three-quarter  inch  experimental  drills  consists  of:  (1)  new 

drills  with  a  conventional  grind  (2)  reground  drills  with  a 
conventional  grind  (3)  reground  drills  with  a  four  facet  grind 
(4)  reground  drills  with  a  helical  grind.  The  experiments  are 
being  conducted  within  a  manufacturing  instead  of  a  laboratory 
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environment.  Because  of  this  the  drills  cannot  be  allowed 
to  fail  and  ruin  the  workpieces  (a  component  of  the  MlAl  tank’s 
main  gun) ,  they  must  be  removed  prior  to  failure.  Drill  removal 
is  at  the  discretion  of  the  machine  operator,  whose  removal 
decision  is  based  on  sensory  signals  given  off  by  the  drill. 

The  objective  of  the  current  effort  is  to  prove  the 
feasibility  of  using  neural  networks  to  forecast  the  life  of 
three-quarter  inch  drills  used  on  a  component  of  a  MlAl  tank's 
main  gun.  However,  data  was  gathered  on  many  tool  parameters  so 
this  effort  also  included  a  statistical  analysis  of  the  data. 

This  was  included  primarily  to  establish  an  understanding  of  the 
working  phenomena  that  might  be  useful  in  the  development  of  a 
neural  network.  The  statistical  analysis  was  conducted  prior  to 
the  neural  network  activity  and  is  the  subject  of  a  companion 
report.  The  neural  network  Investigation  is  the  subject  of  this 
report . 

The  feasibility  of  using  one  or  more  neural  networks  to 
forecast  tool  life  was  determined  by  developing  neural  networks 
and  testing  them  for  forecast  accuracy.  Development  and  test  was 
carried  out  using  NETS.  The  NETS  is  a  neural  network  simulation 
computer  program  developed  by  National  Aeronautics  and  Space 
Agency  (NASA).  The  NETS  simulates  feed-forward,  back-propagation 
neural  networks. 

Tne  first  set  of  neural  netvrorks,  developed  to  forecast  tool 
life,  used  values  of  the  descriptiv'j  parameters,  listed  in  Table 
1.0,  as  the  independent  variables.  This  was  attempted  even 
though  the  prior  statistical  analysis  showed  that  there  is  little 
correlation  between  these  parameters  and  tool  life.  When  this 
approach  did  not  prove  fruitful  two  more  independent  variables 
were  added:  first  workpiece  minimum  thrust  (measured  at  the  ball 
screw  motor  as  a  percent  of  maximum  thrust  the  motor  is  capable 
of  providing)  and  first  workpiece  specific  energy  (measured  at 
the  spindle  motor  as  horsepower  provided  by  the  motor  divided  by 
the  quotient  of  the  cubic  Inches  drilled  and  the  feed 
rate-hp/ (cu. in . /min . ) ) .  The  reason  for  including  these 
^riables  was  tha\.  ^t  was  hypothesized  th  the  values  for  the 
first  piece  might  be  a  measure  of  a  drill  wear-ln.  Different 
values  would  account  for  differences  in  dr^ll  hardness.  This 
excursion  also  failed.  In  another  attempt  the  descriptive 
parameter  values  were  combined  with  a  series  of  dynamic  parameter 
values,  either  thrust  or  specific  energy).  For  these  attempts 
the  average  thrust  or  specific  energy  value  per  workpiece  for  the 
first  five  workpieces  was  used.  This  additional  information  did 
not  improve  the  networks  forecasting  capability.  Therefore,  the 
use  of  descriptive  variables  was  terminated  and  attention  was 
focused  on  the  dynamic  variables.  The  final  result  of  the 
experimentation  was  a  decision  to  use  the  average  thrust  per 
workpiece  for  the  first  9  workpieces  as  the  independent  variable 
and  total  inches  drilled  per  twist  drill  as  the  dependent 
variable.  It  was  decided  to  use  inches  drilled  instead  of 
workpieces  completed  as  the  dependent  variables  in  case  the 
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results  have  a  more  general  application  to  other  drill  and 
workpiece  combinations. 

Based  on  the  results  of  this  effort  It  is  concluded  that 
neural  networks  c^n  be  developed  with  the  capability  of 
forecasting  tool  life.  However,  for  this  study  the  amount  of 
available  data  was  insufficient  to  both  train  and  test  a  network. 
To  achieve  sufficient  accuracy  all  of  the  available  data  was  used 
in  the  training  set  for  the  last  network  that  was  developed. 
However,  the  test  program  is  continuing  and  as  more  data  is 
generated  the  neural  networks  will  be  updated. 

2.  DATA: 

Characteristic  drill  and  workpiece  variables  are  listed  in 
Table  1.0  and  the  relationship  between  the  drill  variables  and 
drill  geometry  are  shown  in  Figure  1.0.  Data  was  collected  on: 
the  first  thirteen  variables.  In  addition,  data  was  collected  on: 
(1)  tool  life  (inches  drilled,  workpieces  completed,  and  tool  lip 
wear)  ,  (2)  thrust--percent  of  maximum  d.c.  current  required  by 

the  ball  screw  motor--  (3)  specific  energy  (hp/ (cu. in . /min . ) ) 
provided  by  the  spindle  motor  to  turn  the  drill.  The  dynamic 
parameter  data,  thrust  and  specific  energy,  were  collected  every 
tenth  of  an  inch  drilled.  For  each  workpiece  0.3  inches  were 
drilled:  8  inches  for  four  2  inch  through  holes  and  an 

additional  1.3  inches  for  2  blind  holes.  However,  since  there 
was  little  variation  in  the  data  per  measurement  or  average  per 
hole  an  average  per  workpiece  (0.3  inches)  was  used. 

The  descriptive  variable  values  are  shewn  in  Tables  2.0  - 
5.0.  The  data  for  25  new  drills  (23  manufacturer  A  and  2 
manufacturer  B)  are  shown  in  Table  2.0.  Data  for  27  reground 
drills  (22  A  and  5  B)  with  a  conventional  grind  are  presented  in 
Table  3.0.  Data  for  16  reground  drills  with  a  four  faceted  grind 
are  shown  in  Table  4.^  and  Table  5.0  is  for  2  reground  helical 
grind  drills.  The  drills  in  these  last  two  tables  are  all  *A' 
drills.  Regrlnding  was  done  by  in-house  machinists.  Tables 
6. 0-0.0  contain  performance  data:  Inches  drilled,  workpieces, 
..otal  wear  (mllli.  jters)  and  wear  rate  (mi  1 1  imeters/ inch)  .  I'otal 
wear  was  measured  after  the  operator  Judged  that  the  tool  had 
reached  the  end  of  its  useful  life  and  removed  it  from  the 
machine.  Measurements  were  taken  directly  from  photos  of  the 
dull  drill  points.  The  constant  wear  rate  was  calculated  from 
total  wear  and  inches  drilled. 

There  are  25  new  drills  of  which  23  are  from  the  same 
manufacturer.  The  analysis  of  dr.ill  variables;  point  angle, 
relief  angle,  etc.  are  limited  to  22  of  these  23  drills  unless 
otherwise  noted. 
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TABLE  1.0 


CHARACTERISTIC  VARIABLES 

1.  POINT  ANGLE 

2.  RELIEF  ANGLE 

3.  CHISEL  EDGE  LENGTH 

4.  WEB  THICKNESS 

5.  DRILL  SURFACE  TREATED  OR  UNTREATED 

6.  CRYOGENIC  TREATMENT 

7.  ION  IMPLANTATION  SURFACE  TREATMENT 

8.  LOW,  MEDIUM,  OR  HIGH  ION  FLUX 

0.  DRILL  COATED  OR  NOT  COATED  WITH  TIN 

10.  DRILL  MANUFACTURERS -2 

11.  DRILL  NEW  OR  REGROUND 

12.  TYPE  OF  GRIND-CONVENTIONAL,  HELICAL, 
FOUR  FACET 

13.  DRILL  STRESS  RELIEVED  OR  NOT 

14.  DRILL  HARDNESS 

15.  WORKPIECE  HARDNESS 


TABLE  2.0 

NEW  DRILL  DESCRIPTIVE  DATA 
CONVENTIONAL  POINT  GRIND 


TEST 

SEQ. 

MFG. 

PT. 

ANGLE 

RELIEF 

ANGLE 

CEL 

WEB 

CEL/WEB 

CRYO 

TRTD 

ION 

TRTD 

FLUX 

LEVEL 

TIN 

CTD 

1 

A 

118 

10 

.050 

.042 

1 .  190 

NO 

NO 

N/A 

YES 

6 

A 

118 

10 

.056 

.045 

1.240 

NO 

NO 

N/A 

YES 

0 

A 

118 

10 

.002 

.051 

1.220 

YES 

NO 

N/A 

YES 

10 

A 

118 

10 

.066 

.056 

1.210 

YES 

NO 

N/A 

YES 

11 

B 

118 

8 

.  no 

.099 

1.110 

NO 

NO 

N/A 

YES 

12 

B 

1 18 

8 

.  no 

.099 

1.110 

NO 

NO 

N/A 

YES 

13 

A 

118 

10 

.050 

.042 

1  .  190 

YES 

NO 

N/A 

YES 

17 

A 

120 

8 

.072 

.065 

1  .  150 

NO 

NO 

N/A 

YES 

20 

A 

122 

10 

.009 

.061 

1  .  130 

NO 

NO 

N/A 

YES 

20 

A 

120 

11 

.068 

.076 

1  .  100 

NO 

NO 

N/4 

YES 

27 

A 

120 

10 

.062 

.053 

1  .  170 

NO 

NO 

N/A 

YES 

28 

A 

120 

11 

.041 

.034 

1.210 

NO 

NO 

N/A 

YES 

4 


DRILL  GEOMLTRr 


r/GO^E.  /-  O 
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33 

A 

120 

11 

.054 

.047 

1 .  150 

NO 

NO 

N/A 

YES 

38 

A 

118 

10 

.062 

.054 

1.  150 

NO 

NO 

N/A 

YES 

58 

A 

120 

8 

.072 

.065 

1 .  150 

NO 

YES 

LOW 

YES 

61 

A 

120 

6 

.050 

.051 

1  .  160 

NO 

YES 

HIGH 

YES 

62 

A 

120 

4 

.063 

.055 

1 .  150 

NO 

YES 

MED 

YES 

63 

A 

118 

4 

.068 

.054 

1.260 

NO 

NO 

N/A 

YES 

67 

A 

122 

4 

.053 

.044 

1.200 

NO 

NO 

N/A 

YES 

71 

A 

124 

4 

.053 

.045 

1 .  180 

NO 

NO 

N/A 

YES 

70 

A 

122 

10 

.072 

.062 

1.160 

NO 

YES 

MED 

YES 

80 

A 

122 

8 

.071 

.063 

1 .  130 

NO 

YES 

MED 

YES 

81 

A 

122 

8 

.072 

.062 

1 .  160 

NO 

YES 

MED 

YES 

83 

A 

120 

8 

.075 

.065 

1 .  150 

NO 

NO 

N/A 

YES 

01» 

A 

122 

7 

.052 

.045 

1 .  156 

NO 

HO 

N/A 

YES 

•  NOT 

USED 

IN  STATISTICAL 

ANALYSIS 

AND  SOME 

NEURAL 

NETWORKS 

BECAUSE  ANALYSIS  WAS  COMPLETED  BEFORE  TEb.^NO  WAS  COMPLETED. 


MFO  *  MANUFACTURER 
A  =  OUHRINQ 
B  «  PTD 
PT  »  POINT 

CEL  >  CHISEL  EDGE  LENGTH  IN  INCHES 
WEB  «  WEB  THICKNESS  IN  INCHES 


TABLE  3.0 

REGROUND  DRILLS  DESCRIPTIVE  DATA 
CONVENTIONAL  POINT  GRIND 


TEST  MFG.  PT.  RELIEF  CEL  WEB  CEL/WEB  CRYO  ION  FLUX  TIN  STRESS 


SEQ. 

ANGLE 

ANGLE 

TRTD 

TRTD 

LVL 

CTD 

RELIEF 

4 

A 

120 

7 

.  143 

.  113 

1.270 

NO 

NO 

N/A 

NO 

NO 

5 

A 

1 18 

9 

.063 

.052 

1.210 

NO 

NO 

N/A 

NO 

NO 

7 

A 

118 

4 

.044 

.041 

1.070 

NO 

NO 

N/A 

NO 

NO 

8 

A 

1 18 

7 

.075 

.060 

1.090 

NO 

NO 

N/A 

NO 

NO 

16 

B 

118 

7 

.062 

,053 

1 .  170 

NO 

NO 

N/A 

NO 

NO 

6 


18 

A 

120 

6 

.050 

.053 

1.110 

NO 

NO 

N/A 

NO 

NO 

22 

A 

120 

8 

.062 

.038 

1.630 

NO 

NO 

N/A 

NO 

NO 

24 

A 

120 

5 

.053 

.045 

1 .  180 

NO 

NO 

N/A 

NO 

NO 

20 

A 

120 

10 

.042 

.037 

1.300 

NO 

NO 

N/A 

NO 

NO 

30 

A 

120 

10 

.046 

.040 

1.150 

NO 

NO 

N/A 

NO 

NO 

31 

A 

120 

12 

.042 

.030 

1.400 

NO 

NO 

N/A 

NO 

NO 

32 

A 

124 

12 

.048 

.037 

1.300 

NO 

NO 

N/A 

NO 

NO 

34 

A 

120 

10 

.035 

.031 

1 .  130 

NO 

NO 

N/A 

NO 

NO 

36 

A 

120 

11 

.071 

.050 

1.420 

NO 

NO 

N/A 

NO 

NO 

30 

A 

116 

12 

.053 

.048 

1 .  100 

NO 

NO 

N/A 

NO 

NO 

45 

A 

122 

14 

.044 

.025 

1.760 

NO 

NO 

N/A 

NO 

NO 

50 

B 

120 

0 

.044 

.035 

1.260 

NO 

NO 

N/A 

NO 

NO 

51 

B 

120 

8 

.044 

.035 

1.260 

NO 

NO 

N/A 

NO 

NO 

52 

A 

120 

5 

.060 

.058 

1.100 

NO 

NO 

N/A 

NO 

NO 

54 

A 

118 

4 

.040 

.034 

1.180 

NO 

NO 

N/A 

NO 

NO 

55 

A 

120 

4 

.004 

.067 

1.400 

NO 

NO 

N/A 

NO 

NO 

64 

A 

120 

6 

.060 

.054 

1.200 

NO 

NO 

N/A 

NO 

YES 

66 

A 

120 

7 

.063 

.048 

1.310 

NO 

NO 

N/A 

NO 

YES 

70 

B 

122 

5 

.  125 

.000 

1.260 

NO 

NO 

N/A 

NO 

NO 

82 

A 

120 

5 

.066 

.051 

1.200 

NO 

NO 

N/A 

YES 

NO 

85 

B 

120 

5 

.058 

.047 

1.230 

NO 

NO 

N/A 

YES 

NO 

87 

A 

120 

5 

.072 

.058 

1.240 

NO 

NO 

N/A 

YES 

NO 

STRESS  RELIEF  >  A  NON- HEAT  TREATMENT 
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TABLE  4.0 


REGROUND  DRILLS  DESCRIPTIVE  DATA 
FOUR  FACETED  POINT  GRIND 


TEST 

SEQ 

MFG 

PT. 

ANGLE 

RELIEF 

ANGLE 

CEL 

WEB 

CEL/WEB 

CRYO 

TRTD 

ION 

TRTD 

FLUX 

LVL 

TIN  STRESS 
CTD  RELIEF 

30 

A 

118 

11 

.016 

.012 

1.330 

NO 

NO 

N/A 

NO 

NO 

40 

A 

120 

13 

.016 

.014 

1.140 

NO 

NO 

N/A 

NO 

NO 

53 

A 

120 

6 

.056 

.048 

1 .  170 

NO 

NO 

N/A 

NO 

NO 

56 

A 

123 

9 

.056 

.047 

1 .  190 

NO 

NO 

N/A 

NO 

NO 

57 

A 

118 

5 

.047 

.033 

1.420 

NO 

NO 

N/A 

NO 

NO 

50 

A 

118 

8 

.094 

.075 

1.250 

NO 

NO 

N/A 

NO 

NO 

72 

A 

122 

7 

.025 

.019 

1.320 

NO 

NO 

N/A 

NO 

NO 

73 

A 

122 

5 

.  100 

.071 

1.410 

NO 

NO 

N/A 

NO 

NO 

74 

A 

120 

5 

.069 

.052 

1.330 

NO 

NO 

N/A 

NO 

NO 

75 

A 

124 

5 

.010 

.014 

1.360 

NO 

NO 

N/A 

NO 

NO 

77 

A 

122 

6 

.022 

.015 

1.470 

NO 

NO 

N/A 

NO 

NO 

84 

A 

120 

5 

.016 

.013 

1.230 

NO 

NO 

N/A 

YES 

NO 

86 

A 

120 

5 

.010 

.008 

1.250 

NO 

NO 

N/A 

YES 

NO 

88 

A 

122 

6 

.016 

.013 

1.230 

NO 

NO 

N/A 

YES 

NO 

89« 

A 

120 

5 

.022 

.017 

1 . 290 

NO 

NO 

N/A 

NO 

NO 

00« 

A 

120 

5 

.014 

.011 

1.270 

NO 

NO 

N/A 

NO 

NO 

92« 

A 

124 

7 

.025 

.020 

1.250 

NO 

NO 

N/A 

NO 

NO 

93* 

A 

124 

6 

.020 

.015 

1.330 

NO 

NO 

N/A 

NO 

NO 

knot  used  in  statistical  analysis  and  some  neural  NET«K}RKS 
BECAUSE  ANALYSIS  WAS  COMPLETED  BEFORE  TESTING  WAS  COMPLETED. 
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TABLE  5.0 

REGROUND  DRILLS  DESCRIPTIVE  DATA 
HELICAL  POINT  GRIND 


TEST 

SEQ 

MFG 

PT. 

ANGLE 

RELIEF 

ANGLE 

CEL 

WEB 

CEL/WEB 

CRYO 

TRTD 

ION 

TRTD 

FLOX 

LVL 

TIN 

CTD 

STRESS 

RELIEF 

08 

G 

122 

5 

.  no 

.  104 

1 .  140 

NO 

NO 

K/A 

NO 

NO 

00 

G 

122 

5 

.  120 

.113 

1 .  120 

NO 

NO 

N/A 

NO 

NO 

TABLE  0.0 


NEW  DRILLS  PERFORMANCE  DATA 
CONVENTIONAL  POINT  GRIND 


TEST 

TOOL  LIFE 

TOOL  LIFE 

WEAR  RATE 

TOOL  LIFE 

SEQ 

INCHES  DRILLED 

TOTAL  WEAR 

MM 

MM/ INCH 

WORKPIECES 

1 

204.0 

.31 

.00152 

22 

0 

241.8 

.34 

.00141 

28 

0 

213.0 

.27 

.00120 

23 

10 

107.4 

.21 

.00125 

18 

11 

200.4 

.28 

.00107 

28 

12 

200.7 

.28 

.00104 

20 

13 

270.0 

.31 

.Ov,ill 

30 

17 

440.4 

.34 

.00070 

48 

20 

300.0 

.31 

.00070 

42 

20 

204.0 

UNK 

UNK 

22 

27 

200.4 

.28 

.00108 

28 

28 

241.8 

.31 

.00128 

28 

33 

288.3 

.30 

.00104 

31 

38 

300.0 

.30 

.00008 

33 

58 

474.3 

.30 

.00082 

51 

01 

344. 1 

.31 

.00000 

37 

02 

105.3 

.28 

.00143 

21 

03 

204.0 

.25 

.001-.- 

22 

07 

158. 1 

.31 

.00108 

17 

71 

310.2 

.28 

.00088 

34 

70 

241.8 

.28 

.00118 

28 

80 

130.5 

.22 

.00158 

15 

81 

241.8 

.32 

.00132 

28 

83 

325.5 

.25 

.00077 

35 

01 

405.0 

.31 

.00087 

50 

UNK  > 

TOTAL  WEAR  WAS 

NOT  MEASURED 

FOR  THIS  DRILL 
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TABLE  7.0 


REGROUND  DRILLS  PERFORMANCE  DATA 
CONVENTIONAL  POINT  GRIND 


TEST 

TOOL  LIFE 

TOOL  LIFE 

WEAR  RATE 

TOOL  LIFE 

SEQ 

INCHES  DRILLED 

TOTAL  W&Mt 

MM/ INCH 

WORKPIECES 

MM 

4 

65. 1 

.  16 

.00245 

7 

5 

65. 1 

.  13 

.00190 

7 

7 

102. 1 

.  16 

.00156 

11 

e 

167.4 

.28 

.00167 

18 

le 

65. 1 

.  16 

.00245 

7 

18 

223.2 

.37 

.00165 

24 

22 

148.8 

.27 

.00181 

16 

24 

55.8 

.  17 

.00304 

6 

29 

03.0 

UNK 

UNK 

10 

30 

176.7 

.30 

.00220 

19 

31 

130.5 

UNK 

UNK 

15 

32 

83.7 

UNK 

UNK 

0 

34 

186.0 

.33 

.00177 

20 

36 

120.9 

UNK 

UNK 

13 

30 

167.4 

.25 

.00140 

18 

45 

148.8 

.28 

.00188 

16 

50 

102.3 

.23 

.00224 

11 

51 

207.6 

.39 

.00131 

32 

52 

83.7 

.23 

.00274 

0 

54 

120.0 

.28 

.00231 

13 

55 

55.8 

.  15 

.00268 

6 

64 

158.1 

.31 

.00106 

17 

66 

46.5 

.  18 

.00387 

5 

70 

241.8 

.23 

.00095 

26 

82 

353.4 

.39 

.00110 

38 

85 

306.9 

.28 

.00091 

33 

87 

334.8 

.34 

.00102 

36 
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TABLE  8.0 


REGROUND  DRILLS  PERFORMANCE  DATA 
FOUR  FACETED  POINT  GRIND 


TEST 

TOOL  LIFE 

TOOL  LIFE 

WEAR  RATE 

TOOL  LIFE 

SEQ 

INCHES  DRILLED 

TOTAL  (WEAR 

MM 

MM/ INCH 

WORKPIECES 

37 

130.5 

.  17 

.00121 

15 

40 

316.2 

.44 

.00130 

34 

53 

288.3 

.30 

.00135 

31 

56 

83.7 

.23 

.00274 

0 

57 

186.0 

.30 

.00200 

20 

50 

204.6 

.30 

.00100 

22 

72 

130.5 

.23 

.00164 

15 

73 

102.3 

.  13 

.00127 

11 

74 

120.0 

.23 

.00100 

13 

75 

167.4 

.30 

.00232 

18 

77 

213.0 

.40 

.00187 

23 

84 

446.4 

.36 

.00080 

48 

86 

344. 1 

.26 

.00072 

36 

88 

455.7 

.36 

.00070 

40 

80 

260.7 

.36 

.00140 

26 

00 

207.6 

.42 

.00141 

32 

02 

418.5 

.30 

. 00003 

45 

03 

344.1 

.36 

.00105 

37 

TABLE  0.0 


REGROUND  DRILLS  PERFORMANCE  DATA 
HELICAL  POINT  GRIND 


TEST 

TOOL  LIFE 

TOOL  LIFE 

WEAR  RATE 

TOOL  LIFE 

SEQ 

INCHES  DRILLED 

TOTAL  WEAR 

MM 

MM/ INCH 

WORKPIECES 

68 

130.2 

.31 

.00238 

14 

60 

148.8 

.34 

.00228 

16 

3 .  NEURAL  NETWORK : 
a.  Analyaia: 

(1)  Scaling  of  Data: 

NETS  raqulraa  that  tha  input  and  output  data  be  scalad 
batwaan  tha  thaoratical  limita  of  zaro  and  ona .  Thaaa  ara  tha 
thaoratical  limita;  in  practica  tha  limita  ara  .1  and  .0.  To 
acala  tha  data  tha  minimum  and  maximum  valuaa  a  raaalactad  from 
all  of  tha  aval  labia  problam  daacription  data  (input  data)  and 
all  availabla  problam  aolution  data  (output  data).  For  thia 
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scaling  the  minimum  and  maximum  values  used  in  the  scaling  must 
span  the  minimum  and  maximum  values  that  could  be  realized  in  a 
working  environment,  otherwise  it  is  possible  that  a  problem  will 
be  encountered  with  values  outside  the  scaling  range.  A 
possible  strength  of  scaling  is  that  all  problems  are  scaled 
using  the  same  values  thereby  creating  a  relationship  between 
problems.  For  this  study  the  minimum  and  maximum  values  were 
selected  from  che  values  for  all  tested  drills,  new  and  reground. 

(2)  Training  Criteria: 

The  training  criteria  value  is  set  by  the  network  developer 
and  it  is  the  maximum  error,  between  the  actual  answers  and  the 
neural  network’s  generated  answers  for  each  example  in  the 
training  set,  that  the  network  developer  will  accept.  When  the 
network  achieves  this  value,  during  training,  the  training  phase 
is  terminated  and  the  test  phase  can  be  initiated.  The  developer 
can  set  this  criteria  at  as  low  a  value  as  is  desired,  however, 
improvements  in  network  test  case  accuracy  tends  to  diminish  as 
the  criteria  is  made  smaller,  at  least  for  this  problem.  The 
accuracy  of  the  solutions  for  training  examples  improves  but  the 
accuracy  for  unknown  teat  examples  not  contained  in  the  training 
set  diminishes.  Specific  knowledge  is  gained  but  generalization 
capability  is  lost. 

To  determine  the  impact  of  training  criteria  on  accuracy, 
for  this  problem,  an  experiment  was  conducted  in  which  the 
training  criteria  was  set  at  14  values.  This  was  done  within  the 
context  of  one  training  session.  The  criteria  was  first  set  at  a 
high  value  and  the  network  was  trained  to  this  value  and  then  it 
was  tested.  Then  the  training  was  resumed  from  the  stopping 
point  but  with  a  new  lower  criteria. 

This  was  continued  for  14  training  criteria  values  .5  - 
.008.  For  each  criteria  value  the  network  was  first  trained  and 
then  challenged  with  the  training  set  (17  out  of  20  available 
manufacturer  'A*  drills)  and  then  with  the  remaining  3  unknown 
manufacturer  *A'  drills.  The  minimum  and  maximum  errors  for  each 
criteria  value  for  the  training  set  are  shown  in  Figure  2.t,  the 
minimum  and  maximum  errors  for  each  criteria  value  for  the  test 
set  are  shown  in  Figure  3.0  and  the  root  mean  square  error  for 
the  training  set,  test  set,  and  the  combined  training  and  test 
set  are  shown  in  Figure  4.0.  As  the  training  criteria  value  is 
reduced  the  upper  and  lower  bounds  on  the  prediction  error  for 
the  training  set  converge  on  zero.  Figure  2.0.  However,  for  the 
test  set.  Figure  3.0,  the  upper  and  lower  bounds  start  to 
converge  at  a  criteria  value  of  approximately  .26.  But,  at  a 
criteria  value  of  .05  the  bounds  stop  converging.  This  fact  is 
brought  out  in  Figure  i.O  which  is  a  plot  of  root  mean  square 
error.  For  the  test  set  this  parameter  flattens  out  at  approxi¬ 
mately  .05.  Therefore,  for  this  effort  the  training  criteria  was 
set  at  a  value  of  .05. 
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(3)  Objactlv*  Crltarla: 


In  a  working  •nvlronniont  th«r«  would  b«  limits  on  ths  nsural 
nstwork’s  dscisions.  For  this  invsst Igatlon  it  was  dacldad  to 
astablish  an  accaptabls  srror  of  plus  or  minus  two  workplscas  or 
plus  or  minus  18.6  inchas.  In  addition  ths  minimum  accaptabls 
foracast  for  inchas  drlllad  with  a  naw  drill  was  sat  at  130.5  and 
tha  maxlmiim  was  sat  at  474.3.  Thasa  ara  tha  minimum  and  maximum 
valuas  for  tha  naw  drills.  If  a  natwork  foracast,  a  valua  lass 
than  139.5,  tha  foracast  is  sat  to  130.5  and  if  it  foracast  a 
valua  graatar  than  474.3  tha  valua  is  sat  at  474.3.  For  raground 
convantional  grind  drills  tha  valuas  ara  03.0  and  353.4.  For 
raground  four  facat  grind  tha  valuas  ara  102.3  and  455.7.  Tabla 
10.0  shows  tha  training  crltarla  ra^ults. 


TABLE  10.0 

TRAININQ  CRITERIA  TRAININO  SESSION 
NUMBER  OF  FORECASTS  BETWEEN 
PLUS  AND  MINUS  TWO  WORKPIECES 

CRITERIA  LEVEL  TRAINING  SET  TEST  SET 

(17  EXAMPLES)  (3  EXAMPLES) 


.5 

2 

0 

.4 

3 

0 

.3 

4 

0 

.2 

10 

0 

.  1 

13 

1 

.08 

12 

2 

.06 

15 

2 

.05 

16 

1 

.04 

16 

1 

.03 

17 

1 

.02 

17 

0 

.01 

17 

1 

.009 

17 

1 

.008 

17 

1 

(4)  Problam  Dafinltlon: 

Tha  dynamic  data  available  for  problam  definition  included 
tha  thrust  and  specific  energy  (hp/ (cu. in . /in) ) .  During  drilling 
thrust  is  measured  every  tenth  of  an  inch.  For  specific  energy 
both  horsepower  and  feed  rata  ara  measured  every  tenth  of  an  inch 
and  thasa  valuas  ara  used  to  derive  specific  energy.  Tha  thrust 
maasuramants  ara  taken  at  tha  ball  screw  motor  and  tha  horsepower 
maasuramants  ara  taken  at  tha  spindle  motor.  For  this  effort  tha 
independent  variables  ware  average  thrust  and  average  specific 
energy  par  workpiece  (0.3  drilling  inchas). 

Tha  thrust  and  specific  energy  valuas  ware  derived  for  each 
two  inch  hole,  four  holes  par  workpiece,  from  tha  last  three 
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PREDICTION  ERROR 


lA 


I  CRITERIA  VS.  TEST  SET  PREDICTION  ERROR  BOUNDS 
NUNBER  OF  TEST  SET  EXAMPLES  3 

T - 1— I - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - T 


OVER  PREDICTION 


UNDER  PREDICTION 


I  I - ■  I  «  ■  ■  ■  I  ■  <  ■  ■  ' _ I _ ■  » 

0.24  0.38  0.40 

LEARNING  CRITERIA 
FIGURE  3.0 
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iNING  CRITERIA 
FIGURE  4.0 


measurements  per  hole.  These  four  values  were  then  used  to 
determine  a  workpiece  average.  From  this  data  two  additional 
problem  aefinitlon  methods  were  developed:  smoothed  and  first 
differences  for  both  average  thrust  and  average  specific  energy. 

Tool  lif  .  (inches  drilled)  forecasting  networks  were  trained 
and  tested  f<  each  of  the  problem  definition  methods.  The 
training  set  consisted  of  the  IS  new  drills  from  manufacturer 
'A.*  The  test  set  consisted  of  the  remaining  6  manufacturer  'A* 
examples.  Equation  (1)  is  the  smoothing  equation  and  equation 
(2)  is  the  first  difference  equation.  The  smoothing  produced 
problem  definition  of  nine  values  and  the  first  difference 
produced  problem  definition  of  7  values.  The  results  are  shown 
in  Table  11.0. 

(1)  T(i)  *  T(i-l)  ♦  2T(i)  ♦  T(i  ♦!)  /  4 

(2)  T(i)  »  TCi  +1)  -  T(i  -1)  /  2 


TABLE  11.0 
PROBLEM  DEFINITION 


TRAINING 

SET  =  15 

EXAMPLES 

TEST  SET 

-  6  EXAMPLES 

PARAMETER 

RMSEs 

RMSE 

NUMBER  OF 

NUMBER  OF 

TRAINING 

TEST 

TRAINING  SET 

TSwi’  SET 

SET 

SET 

FORECASTS 

FORECASTS 

WITHIN  TWO 

WITHIN  TWO 

WORKPIECES 

WORKPIECES 

THRUST 

7.2 

117.8 

15 

1 

SMOOTHED 

THRUST 

8.32 

58.3 

15 

2 

1ST 

18.01 

158.0 

11 

0 

DIFFERENCE 

THRUST 

SPECIFTC 

ENERGY 

15.0 

47.72 

13 

1 

SMOOTHED 

SPECIFIC 

ENERGY 

12.0 

88.00 

14 

1 

1ST 

DIFFERENCE  NETWORK  WOULD  NOT  TRAIN 

SPECIFIC 

ENERGY 

»  ROOT  MEAN  SQUARE 

FORECASTING  ERROR 
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Thrust  and  smoothed  thrust  did  very  twell  when  challenged 
with  the  training  set,  however,  neither  achieved  an  acceptable 
accuracy  when  challenged  with  a  test  set.  In  fact  the  best 
accuracy  when  challenged  with  the  test  set  was  specific  energy, 

however,  it  did  not  do  as  well  in  learning  the  training  set. 

Since  none  of  these  approaches  fulfilled  performance  expectations 
examples  were  moved  from  the  test  set  to  the  training  set.  This 
was  done  in  order  to  increase  the  neural  networks  knowi.edge 
concerning  the  span  of  possible  problems.  It  was  hoped  that  at 
some  training  set  teat  set  combination  the  accuracy  for  both  sets 

would  fulfill  expectations.  This  goal  was  not  achieved  so  it  was 

decided  to  include  all  of  the  examples  in  the  training  set.  The 
results  for  this  option  are  shown  in  Table  12.0. 


TABLE  12.0 


PROBLEM  DEFINITION 
TRAINING  SET  =21  EXAMPLES 


PARAMETER 

RMSE 

TRAINING 

SET 

NUMBER  OF 
TRAINING  SET 
FORECASTS 
WITHIN  TWO 
WORKPIECES 

THRUST 

8.64 

21 

SMOOTHED 

THRUST 

15.59 

19 

SPECIFIC 

ENERGY 

8.37 

21 

SMOOTHED 

SPECIFIC 

ENERGY 

11.63 

20 

This  effort  . esulted  in  the  elimlr  .on  of  both  smoothed 
approaches  from  further  considerations.  This  was  done  for  two 
reasons:  (1)  their  performance  was  not  equal  to  the  other 

approaches,  and  (2)  as  the  number  of  examples  in  the  training  set 
increased  the  capability  of  the  network  to  converge  to  the 
training  criterium  value  became  more  and  more  difficult.  Since 
the  amount  of  training  examples  will  increase  in  the  future  this 
convergence  difficulty  could  become  more  of  a  problem. 

Although  specific  energy  has  a  slight  accuracy  advantage 
over  thrust,  the  RMSE  values  are  both  within  one  workpiece. 
Because  of  these  results,  specific  energy  was  eliminated  from 
further  consideration  since  it  requires  a  more  complicated 
sensing  system;  it  requires  that  both  horsepower  and  feed  rate  be 
monitored:  and  since  it  is  a  quotient,  slight  changes  in  either 
of  these  variables  can  have  a  sizeable  impact. 
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(5)  Required  Number  of  Inputs  to  Define  Problem: 

The  minimum  number  of  workpieces  completed  by  s  new  drill 
was  fifteen.  If  each  piece  provides  one  data  point  for  problem 
definition  It  i.'*  possible  to  use  data  from  up  to  fourteen 
workpieces  for  problem  definition.  To  determine  the  number  of 
data  points  that  provide  the  best  problem  definition  neural 
networks  were  trained  using  from  five  to  fifteen  data  points  per 
problem.  Five  values  networks  would  not  converge  to  the  .05 
training  criteria.  For  all  of  these  experiments  the  training  set 
consisted  of  15  examples  and  the  test  set  consisted  of  6 
examples.  Results  are  furnished  in  Table  13.0 


TABLE  13.0 

NETWORK  ACCURACY  FORECASTING  TOTAL  INCHES  DRILLED 


NUMBER  OF  AVERAGE 

RSME 

RMSE 

NUMBER  OF 

NUMBER  OF 

THRUST  VALUES 

TRAINING 

TEST 

TRAINING  SET 

TEST  SET 

SET 

SET 

FORECASTS 

FORECASTS 

WITHIN  TWO 

WITHIN  TWO 

WORKPIECES 

WORKPIECES 

5» 

N/A 

N/A 

N/A 

N/A 

6 

15.7 

93.7 

14 

2 

7 

11.0 

83.0 

15 

1 

8 

12.2 

75.4 

14 

0 

9 

7.2 

117.8 

15 

1 

10 

40.0 

88.5 

8 

1 

11 

35.0 

144.5 

8 

0 

12 

39.5 

126.5 

10 

0 

13 

40.3 

151.2 

8 

1 

14 

25.9 

123.3 

11 

0 

15 

27.3 

143.7 

9 

1 

*  Would  not  converge. 

None  of  the  results  for  Input  values  of  9  or  less  Is  In 
every  respect  the  best.  However,  an  attempt  was  made  to  Improve 
network  accuracy  by  adding  training  examples  to  the  training  set. 
The  additional  examples  caused  the  6  element  case  to  reach  a 
point  were  the  network  would  not  converge.  The  7  element  case 
would  converge  but  convergence  became  difficult.  Therefore,  it 
was  decided  that  problem  definition  would  require  at  least  9 
elements . 

(6)  Number  of  Training  Set  Examples: 

A  rule  of  thumb  lor  the  number  of  examples  to  be  included  in 
the  training  set  is  that  it  should  be  5  to  10  times  the  number  of 
weights  from  the  input  layer  to  the  middle  layer.  For  this 
effort  the  input  layer  has  9  nodes  and  the  middle  Isyer  has  4 
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nodes  which  squatss  to  36  weights  or  to  a  training  set  require¬ 
ment  of  between  180  and  360  examples.  For  this  effort  the  amount 
of  time  required  to  gather  data  for  one  drill  can  vary  between  2 
and  6  weeks.  Therefore,  the  amount  of  tisie  required  for  a 
minimum  set  is  360  weeks  or  approximately  7  years.  This  does  not 
include  the  requirements  for  a  test  set  with  which  to  challenge 
the  trained  network.  The  current  effort  does  have  viable  data  on 
23  new  drills;  21  from  manufacturer  *A*  and  two  from  manufacturer 
'B. '  The  impact  of  the  number  of  examples  in  the  training  set 
was  tasted  with  data  from  this  set,  primarily  from  the  21 
manufacturers  of  'A*  drills.  The  results  are  shown  in  Table 
14.0. 


TABLE  14.0 


IMPACT  ON  ACCURACY  OF  NUMBER  OF  EXAMPLES  IN  TRAINING  SET 
AVAILABLE  MANUFACTURER  *A‘  DRILLS  =  21 


NUMBER  OF 

NUMBER  OF 

RMSE 

RMSE 

NUMBER  OF 

NUMBER  OF 

EXAMPLES  IN 

EXAMPLES  IN 

TRAINING 

TEST 

TRAINING  SET 

TEST  SET 

TRAINING 

TEST  SET 

SET  SET 

FORECASTS 

FORECASTS 

SET 

WITHIN  TWO 

WITHIN  TWO 

WORKPIECES 

WORKPIECES 

13 

8 

12.64 

100.64 

13 

0 

14 

7 

8.86 

114.33 

14 

1 

15 

6 

7.20 

117.80 

15 

1 

16 

5 

8.38 

101.2 

16 

1 

17 

4 

15.66 

80.44 

13 

0 

18 

3 

10.51 

78.20 

17 

1 

10 

2 

8.80 

70.80 

18 

0 

20 

1 

8.32 

65. 1 

20 

0 

21 

0 

8.84 

N/A 

21 

N/A 

The  neural  networks  are  capable  of  learning  the  specific 
knowledge  contained  in  the  training  set  but  problems  occur  in 
applying  this  specific  knowledge  to  the  general  problem  a'‘t. 
However,  it  is  possible  that  a  more  accurate  network  can  be 
trained  with  something  less  than  160  examples. 

(7)  Mixing  Drills  From  Different  Manufacturers: 

Drills  from  two  manufacturers  were  used  in  this  effort. 
However,  the  number  of  drills  from  each  manufacturer  was  not 
equal,  only  2  of  the  new  drills  were  from  manufacturer  *B. * 
Because  of  this  situation  it  is  possible  to  test  a  neural  network 
capability  to  transfc-  knowledge  learned  from  a  set  of  drills 
from  one  manufacturer  to  drills  from  another  manufacturer. 

Another  possibility  is  to  mix  the  drills  into  the  same  training 
set.  The  set  of  new  drills  available  for  training  and  testing  a 
neural  network  consisted  of  21  from  manufacturer  ‘A*  and  two  from 
manufacturer  *B* .  The  manufacturer  ’B‘  drills  are  test  sequence 
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numbers  11  and  12.  It  is  pointed  out  that  the  descriptive 
statistics  for  these  two  drills  are  almost  identical  and  in 
addition  the  difference  in  performance  was  one  workpiece,  number 
11  completed  26  and  number  12  completed  29  workpieces.  Because 
the  available  data  covers  a  tool  life  span  of  from  139.5  inches 
to  474.3  inches  the  criteria  was  setup  that  if  a  forecast  is 
greater  than  474.3  then  it  is  set  at  474.3  and  if  it  is  less  than 
139.5  it  is  set  at  this  value.  Overestimates  are  shown  as 
negatives  and  underestimates  as  positives.  The  results  are 
shown  in  Table  15.0 


TABLE  15.0 

IMPACT  OP  DIFFERENT  DRILL  MANUFACTURERS 


NUMBER  OF 

NUMBER  OF 

RMSE 

RMSE 

ERROR 

ERROR 

EXAMPLES  IN 

EXAMPLES  IN 

TRAINING 

TEST 

TS  11 

TS  12 

TRAINING 

SET 

TEST  SET 

SET 

SET 

13« 

e« 

12.64* 

109. 04* 

-213.9 

111.0 

14 

7 

8.90 

114.33 

-213.9 

05. 1 

15 

0 

7.20 

117.80 

-213.9 

120.9 

10 

5 

8.38 

101.2 

-213.9 

16.0 

17 

4 

15.08 

89.44 

-213.9 

55.8 

18 

3 

10.51 

78.20 

-213.9 

55.8 

19 

2 

8.80 

70.80 

-213.9 

130.2 

20 

1 

8.32 

05. 1 

-213.9 

55.8 

21 

0 

8.64 

N/A 

-213.9 

93.0 

TRAINING  SET 

INCLUDE  MANUFACTURER 

'B‘  DRILLS 

22«K 

1 

14.79»»»«  N/A 

18.0  9.3 

23»»» 

0 

11.06«»»«  N/A 

0  -27.9 

«  TRAINING  SET  MANUFACTURES  'A*  DRILLS  ONLY 
«»  TRAINING  SET  INCLUDES  MANUFACTURER  *B‘  TSll 
«««  TRAINING  SET  INCLUDES  MANUFACTURER  ‘B'  TSll  AND  TS12 
««««RMSE  IS  FOR  21  MANUFACTURER  'A*  DRILLS 


These  results  indicate  that  a  network  trained  on  drills  from 
one  manufacturer  cannot  be  used  to  forecast  life  for  drills  from 
another  producer.  However,  they  also  indicate,  results  shown  in 
entry  lines  22  and  23  of  the  table,  that  mixing  manufacturer  in 
the  training  set  enables  a  network  to  handle  both  producers. 

These  conclusions  are  tentative  since  only  two  drills  are 
available  from  manufacturer  *B.' 
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(8)  Alt«rn«tlv«  M«thoda  for  Forcaating  Tool  Lifa: 

Thara  ara  altarnatlva  mathoda  for  calculating  tool  lifa, 
thaaa  ara:  (1)  foracaat  total  waar  and  conatant  waar  rata  and 
tha  quotiant  yialda  a  foracaat  of  total  inchaa  drillad;  (2) 
datarmina  a  atandard  total  tvaar ,  maan  total  waar,  foracaat  tha 
conatant  waar  rata,  again  tha  quotiant  yialda  a  foracaat  of  total 
inchaa;  (3)  normaliza  all  axparimantal  inchaa  drillad  data  to  tha 
avaraga  total  waar  and  foracaat  thia  normal izad  valua.  For  thia 
aat  of  axparimanta  tha  training  aat  waa  raducad  from  15  to  14 
axamplaa.  Thia  ia  dua  to  tha  fact  that  ona  of  tha  axamplaa 
containad  in  tha  pravioua  training  aat  waa  miaaing  tha  data  for 
lip  waar.  Tha  normal izad  valuaa  for  tha  aacond  altarnatlva  ara 
ahown  in  Tabla  18.0  and  tha  raaulta  for  all  altarnativaa  ara 
ahown  in  Tablaa  17.0  -  10.0.  Tha  firat  lina  in  aach  of  thaaa 
tablaa  containa  tha  raaulta  of  a  diract  foracaat  aa  a  maana  of 
comparing  tha  altarnativaa. 


TABLE  16.0 

NORMALIZED  TOOL  LIFE  DATA 
NORMALIZED  TO  A  TOTAL  WEAR  OF  . 29MM 


DRILL  TEST 
SEQUENCE 

80 

67 

10 

62 

1 

9 

63 

28 

6 

79 

81 

27 

13 

33 

38 

71 

61 

83 

20 

17 

91 

58 

im 

12« 


ACTUAL 

WORKPIECES 

COMPLETED 

15 

17 

18 
21 
22 
23 
22 
26 
26 
26 
26 
28 

30 

31 

33 

34 
37 

35 
43 
48 

50 

51 
28 
20 


NORMALIZED 

WORKPIECES 

22 

15 

25 

22 

20 

25 

26 
24 
21 

27 
23 
20 

28 
30 
32 
35 
35 
39 

41 
43 
48 

42 
20 
30 


DIFFERENCE 


+7 
-2 
♦7 
♦  1 
-2 
♦  2 
+  4 
-2 
-5 
♦  1 
-1 
♦  1 
-2 
-1 
-1 
♦  1 
-2 

♦  4 
-2 
-5 
-2 
-9 

♦  1 
♦  1 
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TABLE  17.0 


RESULTS  ALTERNATIVE  FORECASTING  METHODS 
FIRST  ALTERNATIVE-FORECAST  BOTH  TOTAL  WEAR  AND  CONSTANT  WEAR  RATE 


RMSE  RICE 
TRAINING  TEST 
SET  SET 


NUMBER  OF 
TRAINING  SET 
FORECASTS 
WITHIN  TWO 
WORKPIECES 


NUMBER  OF 
TEST  SET 
FORECASTS 
WITHIN  TWO 
WORKPIECES 


DIRECT  FORECAST  7.20 


117.80 


15 


1 


TOTAL  WEAR  .005MM  .08MM 

WEAR  RATE  . 000029MM/ INCH  . 000255MM/INCH 
TOTAL  INCHES  8.96  127.2 


N/A 

N/A 

14 


N/A 

N/A 

1 


N/A  Not  Applicable. 


TABLE  18.0 


RESULTS  ALTERNATIVE  FORECASTING  METHODS 
SECOND  ALTERNATIVE-FORECAST  TOTAL  NORMALIZED  TOOL  LIFE 


RMSE  RMSE 
TRAINING  TEST 
SET  SET 


NUMBER  OF 
TRAINING  SET 
FORECASTS 
WITHIN  TWO 
WORKPIECES 


NUMBER  OF 
TEST  SET 
FORECASTS 
WITHIN  TWO 
WORKPIECES 


DIRECT  FORECAST  7.20  117.80 


15 


1 


TOTAL  INCHES  10.54  92.8 


13 


1 


TABLE  19.0 


RESULTS  ALTERNATIVE  FORECASTING  METHODS 
THIRD  ALTERNATIVE-FORECAST  CONSTANT  WEAR  RATE  &  USE  WITH  AVERAGE 

TOTAL  WEAR 


RMSE  RMSE 
TRAINING  TEST 
SET  SET 


NUMBER  OF 
TRAINING  SET 
FORECASTS 
WITHIN  TWO 
WORKPIECES 


NUMBER  OF 
TEST  SET 
FORECASTS 
WITHIN  TWO 
WORKPIECES 


DIRECT  FORECAST  7.20  117.80 


15 


1 


TOTAL  INCHES  43.2  141.4 


7 


2 
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Non*  of  these  alternetlvea  is  as  accurate  as  forecasting 
total  inches  directly,  which  had  an  RMSE  for  the  training  set  of 
7.2  and  the  teat  set  of  117.6. 

Another  possible  method  of  forecasting  total  inches  directly 
is  to  use  input  data  windows  and  average  the  forecast  for  the 
windows  to  derive  a  final  forecast.  This  approach  was  tried  for 
input  values  of  6,  7,  6,  and  0  thrust  values.  For  example  for  a 
window  of  six  values  the  first  forecast  would  use  values  from 
workpieces  1-6,  the  second  2-7,  the  third  3-8  and  the 
fourth  4-0.  However,  the  6  element  window  would  only  train  for 
the  1-6  and  2-7  windows.  The  results  are  shown  in  Table  20.0. 
Method  A  in  the  table  is  the  6  element  window,  it  used 
values  for  1-6  and  2-7.  Method  B  is  the  7  element  window  it  uses 

values  for  1-7  and  2-8.  Method  C  is  the  7  element  window  it  uses 

values  for  1-7,  2-6,  and  3-9.  Method  D  is  also  for  the  7  element 

window  and  it  is  based  on  the  average  for  the  first  two  windows 
and  then  the  results  of  the  third  window  are  added  to  the  average 
and  divided  by  2.  Method  E  is  for  the  8  element  window  1-6  and 
2-9.  The  STD  is  the  current  standard  method  forecasting  total 
inches  directly  using  nine  input  values. 


TABLE  20.0 

WINDOWING  INPUT  DATA 


METHOD 


RMSE  RMSE 
TRAINING  TEST 
SET  SET 


NUMBER  OF 
TRAINING  SET 
FORECASTS 
WITHIN  TWO 
WORKPIECES 


NUMBER  OF 
TEST  SET 
FORECASTS 
WITHIN  TWO 
WORKPIECES 


A 

9.6 

79.3 

15 

B 

9.9 

105.8 

15 

C 

12.4 

77.0 

14 

D 

13.8 

72.4 

13 

E 

10.8 

96.3 

15 

STD 

7.2 

117.8 

15 

1 

1 

1 

1 

0 

1 


With  respect  to  windowing  is  there  on*  window  that  results 
in  a  more  accurate  neural  network?  The  data  is  shown  in  Table 
21.0  for  windows  with  6-9  elements. 
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TABLE  21.0 


EFFECTS  ON  WINDOW  LOCATION 


WINDOW 

ELEMENTS 

RMSE 

RMSE 

NUMBER  OF 

NUMBER  OF 

SIZE 

IN 

RAINING 

TEST 

TRAINING  SET 

TEST  SET 

WINDOW 

SET 

SET 

FORECASTS 

FORECASTS 

WITHIN  TWO 

WITHIN  TWO 

WORKPIECES 

WORKPIECES 

6 

1  - 

6 

15.74 

93.7 

14 

2 

6 

2  - 

7 

11.00 

119.3 

14 

0 

7 

1  - 

7 

11.00 

83.  1 

14 

1 

7 

2  - 

8 

9.90 

105.8 

15 

1 

7 

3  - 

9 

12.48 

76.9 

14 

1 

8 

1  - 

8 

12.24 

75.46 

14 

0 

8 

2  - 

9 

10.74 

96.27 

15 

0 

9 

1  - 

9 

7.20 

117.8 

15 

1 

These  results  Indicate  that  a  neural  netwrork  doesn’t  need 
the  value  from  the  first  workpiece.  But  it  does  need  the  one 
from  the  second.  It  also  shows  that  starting  the  window  at  the 
third  workpiece  is  not  a  good  idea.  It  is  possible  that  the 
first  value  represents  a  wear  in  period  or  some  other  phenomena 
and  that  this  phenomena  is  over  by  the  second  workpiece. 

(9)  Training  Set  Patterns: 

Within  the  tool  lifetime  data  there  are  patterns;  3  tools 
drilled  204.6  inches,  4  tools  drilled  241.8  inches,  and  7  tools 
had  a  total  wear  of  .31mm.  The  question  is;  can  these  patterns 
be  employed  to  assign  examples  to  the  training  set  and  the  test 
set  and  thereby  improve  the  capability  of  the  network?  Table 
22.0  contains  the  data  for  the  3  tool  pattern.  Table  23.0 
contains  the  data  for  the  4  tool  pattern  and  Table  24.0  contains 
the  data  for  the  7  tool  pattern.  With  respect  to  this  last 
table,  data  for  0  tools  is  shown  because  one  tool  is  missing 
thrust  values. 
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TABLE  22.0 


PATTERN  IMPACT  ON  NETWORK  ACCURACY 


NUMBER  OF 

NUMBER  OF 

RMSE 

RMSE 

ERROR 

ERROR 

ERROR 

TRAINING  SET 

TEST  SET 

TRAINING 

TEST 

FOR 

FOR 

FOR 

EXAMPLES 

EXAMPLES 

SET 

SET 

DRILL 

1 

DRILL 

26 

DRILL 

63 

13 

8 

12.64 

100.6 

204.6 

0.3* 

-46.5 

14 

7 

8.06 

114.3 

-223.2 

0.3« 

55.8 

15 

6 

7.2 

117.8 

0» 

0« 

-0.3 

16 

S 

8.4 

101.2 

0 . 3« 

-0.3» 

65. 1 

17 

4 

15.68 

80.4 

0.3« 

0.3« 

65.  1 

18 

3 

10.51 

78.2 

0.3« 

0« 

0« 

»  CONTAINED  IN  TRAINING  SET 
NEGATIVE  VALUE  IS  AN  OVERESTIMATE 
POSITIVE  VALUE  IS  AN  UNDERESTIMATE 


TABLE  23.0 

PATTERN  IMPACT  ON  NETWORK  ACCURACY 


NUMBER  OF 

NUMBER  OF 

RMSE 

RMSE 

ERROR 

ERROR 

ERROR  ERROR 

TRAINING  SET 

TEST  SET 

TRAINING 

TEST 

FOR 

FOR 

FOR  FOR 

EXAMPLES 

EXAMPLES 

SET 

SET 

DRILL 

DRILL 

DRILL  DRILL 

6 

28 

70  81 

13 

8 

12.64 

100.6 

74.4 

46.5 

18. 0«  -130.2 

14 

7 

8.06 

114.3 

74.4 

65. 1 

0»  -176.7 

15 

6 

7.2 

117.8 

-37.2 

102.3 

0«  -186.0 

16 

5 

8.4 

101.2 

46.5 

-18.6 

18. 6»  -8.3« 

17 

4 

15.68 

80.4 

65.1 

-28.2 

8.3»  18. 0« 

18 

3 

10.51 

78.2 

-37.2 

0 

8.3«  -21.9* 

10 

2 

8.8 

70.8 

03.0 

-37.2 

0.3«  0« 

20 

i 

8.32 

65. 1 

0» 

-65.  1 

18. 6«  -18. 6« 

21 

0 

8.84 

0.3»  -8.3» 

18. 6« 

0»  0» 

0  CONTAINED  IN  TRAINING  SET 
NEGATIVE  VALUE  IS  AN  OVERESTIMATE 
POSITIVE  VALUE  IS  AN  UNDERESTIMATE 
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TABLE  24.0 


PATTEKN  IMPACT  ON  NETWORK  ACCURACY 


NUMBER  OF 

NUMBER  OF 

RMSE 

RMSE 

ERROR 

ERROR 

ERROR 

ERROR 

ERROR 

ERROR 

TRNG  SET 

TEST  SET 

TRNG 

TEST 

FOR 

FOR 

FOR 

FOR 

FOR 

FOR 

EXAMPLES 

EXAMPLES 

SET 

SET 

DRILL 

1 

DRILL 

13 

DRILL 

20 

DRILL 

28 

DRILL 

87 

DRILL 

01 

13 

8 

12.84 

100.8 

-204.8 

0« 

18.8* 

48.5 

-120.0 

18.8* 

14 

7 

8.08 

114.3 

-223.2 

0.3* 

-18. 8» 

85. 1 

0» 

-0.3* 

15 

6 

7.2 

117.8 

0*' 

0.3« 

-18. 8» 

102.3 

0« 

0.3* 

18 

5 

8.4 

101.2 

3» 

0» 

0.3« 

-18.8 

0» 

0* 

17 

4 

15.88 

80.4 

3» 

27. 8« 

27. 0» 

-37.2 

0.3* 

-0.3* 

18 

3 

10.51 

78.2 

0. 3« 

-8.3» 

0.3« 

0 

-0.3» 

-0.3» 

10 

2 

8.8 

70.8 

0.3« 

0» 

0 . 3« 

-37.2 

0> 

0» 

20 

1 

8.32 

85.  1 

OH 

0.3« 

0» 

-85.  1 

-0.3» 

-0.3* 

21 

0 

8.84 

0.3« 

0.3tt 

0.3* 

-0.3» 

0.3« 

0* 

«  CONTAINED  IN  TRAINING  SET 

NEGATIVE  VALUE  IS  AN  OVERESTIMATE 
POSITIVE  VALUE  IS  AN  UNDERESTIMATE 

Th«  d«t«  in  th«s«  thr««  t«bl«s  shows  thst  selecting  training 
examples  based  on  some  common  criteria  is  not  sufficient  to  improve  the 
accuracy  of  the  network  with  respect  to  other  drills  within  the  same 
pattern.  The  data  does  show  that  there  is  an  interaction  between  these 
pattern  sets  and  examples  that  do  not  belong  to  the  set.  This  is  shown 
by  a  decrease  in  some  of  the  errors  when  none  member  examples  are  added 
to  the  training  set.  The  results  also  indicate  that  total  inches 
drilled  is  a  better  criteria  than  total  wear. 
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(10)  N«w  Drills  Vs.  Rsground  Drills; 

Within  the  total  data  set  there  are  subsets,  these  are 
defined  in  Table  25.0 


TABLE  25.0 


DATA  SUBSET  DEFINITION 


DRILL  DRILL 

DRILL 

TITANIUM 

STRESS 

CONDITION  MFGR 

GRIND 

NITRIDE 

COATING 

RELIEVED 

NEW  A 

C0NV» 

Y 

Y 

NEW  B 

CONV 

Y 

Y 

REOROUND  A 

CONV 

Y 

N 

REGROUND  A 

CONV 

N 

Y 

REGROUND  A 

CONV 

N 

N 

REGROUND  B 

CONV 

Y 

N 

REGROUND  B 

CONV 

N 

N 

REGROUND  A 

FOUR# 

Y 

N 

REGROUND  A 

FOUR 

N 

N 

REGROUND  A  HELI» 
CONV  »  CONVENTIONAL  GRIND 
FOUR  »  FOUR  FACET  GRIND 

HELI  »  HELICAL  GRIND 

N 

N 

It  is  possible  that  one  neural  network  would  have  the 
capability  to  handle  all  of  these  different  possibilities.  The 
new  drill  work  has  shown  that  a  network  can  handle  variations  in 
certain  parameters  (not  different  manufacturers)  so  the  question 
becomes  can  a  neural  network  handle  new  and  reground  drills.  The 
results  of  this  effort  are  shown  in  Table  25.0. 


L  A 
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TABLE  26.0 


IMPACT  OF 

NEW  AND  REGROUND 

TRAINING  SET 

TEST  SET 

RMSE 

TRNG 

SET 

•A*  NEW 
DRILLS 

REGROUND 
CONV  AND 
FOUR 

19.9 

•A  ♦  B‘ 

REQROUND 

CONV 

•A* 

NEW  AND 

REGROUND 

FOUR 

24.0 

•A' 

FOUR 

'A*  NEW 
AND 

*A  +  B‘ 

REGROUND 

CONV 

13.6 

DRILLS  ON  ACCURACY 


RMSE 

RMSE 

RMSE 

RMSE 

RMSE 

•A* 

■B" 

•A  +  B" 

•A- 

•A* 

CONV 

CONV 

CONV 

FOUR 

NEW 

92.5 

132.2 

102.7 

203.4 

19. 

22.2 

29.4 

24.0 

113.1 

169.8 

24.0 

29.0 

110.2 

13.6 

132.2 

In  addition  to  those  training  seta  several  others  were 
tried;  new  drills  and  conventional  grind  reground  drills,  new 
drills  and  four  facet  grind  reground  drills,  conventional  and 
four  facet  reground  drills.  These  sets  failed  in  training  viable 
neural  networks.  During  training  with  these  sets  the  training 
criteria  of  .09  could  not  be  achieved,  in  fact  the  best  that 
could  be  achieved  was  .300. 

The  results  shown  in  Table  20.0  indicate  that  there  is  a 
difference  between  new  and  reground  drills,  even  if  the  grind  is 
identical  and  both  sets  of  drills  are  from  the  same  manufacturer. 
The  results  for  the  new  drill  neural  network  indicate  that 
regrlnding  has  not  removed  the  difference  between  manufacturer 
*A‘  and  manufacturer  'B*  conventional  grind  drills  as  shown  by 
RUSE  values  of  92.9  for  the  *A*  drills  and  132.2  for  the  'B' 
drills.  The  results  indicate  that  the  four  facet  regrlnd  has 
completely  changed  the  drills,  the  RUSE  for  the  four  facet  case 
is  almost  twice  the  value  for  the  conventional  grind  case,  102.7 
to  203.4. 


(11)  Regrlnding  and  Recoating: 

A  few  of  the  reground  drills  were  also  recoated  with 
Titanium  Nitride;  two  manufacturer  'A‘  conventional  grind,  one 
manufacturer  ’B'  conventional  grind  and  three  manufacturer  'A* 
four  facet  grind.  The  one  of  interest  of  course  is  the 
manufacturer  'A*  conventional  grind  because  this  is  as  close  to 
new  as  can  be  achieved.  The  question  is  did  the  network  trained 
on  new  drills  consider  these  to  be  new  drills.  The  results  are 
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mixed.  For  one  drill  the  ectuel  error  was  zero  and  for  the  other 
drill  it  was  an  underestimate  of  177.4  inches.  For  the 
manufacturer  *B*  conventional  reground  drill  the  error  was  an 
underestimate  of  111.6.  This  could  be  further  evidence  that  the 
reground  drills  do  not  perform  in  the  same  manner  as  new  drills. 


4.  DI8CUS8I0H: 

Three  sets  of  experimental  data  were  available;  new  drills- 
conventional  grind-,  reground-conventional  grind  drills-,  and 
reground-four  facet  grind  drills,  but,  most  of  the  investigations 
used  the  new  drill  data  because  more  new  drill  data  was  available 
and  the  regrinding  operation  added  another  variable. 

Within  the  new  drills  category  some  of  the  drills  in  addition 
to  being  coated  with  Titanium  Nitride  were  also  given  additional 
treatsient  namely;  cryogenic  treatment  (-300  F)  or  ion 
implantation.  Therefore,  within  this  category  the  drills  could 
be  further  divided  into  untreated,  cryogenical ly  treated  or  ion 
implantation . 

The  neural  networks  for  new  and  reground  drills  have  nine 
input  nodes,  four  middle  layer  nodes  and  one  output  node.  All  of 
the  networks  have  been  trained  on  problems  defined  by  the  average 
thrust  values  per  workpiece  and  the  output  is  in  total  Inches 
drilled.  The  thrust  values  are  measured  as  a  percentage  of  the 
total  output  that  the  motor  is  capable  ^f  supplying.  Each 
workpiece  has  four  two  inches  holes  and  two  additional  blind 
holes  that  equal  an  additional  1.9  inches  or  each  workpiece  is 
equivalent  to  0.3  inches  of  metal  drilled. 

For  new  and  reground  drills  equation  (1)  scales  the  thrust 
values  so  that  they  are  between  .1  and  .0. 

(1)  SCALED  «  ((ACTUAL  THRUST  -  MINIMUM  THRUST).  8  /  RA.1CE; 

♦  .  1 

=  ((ACTUAL  THRUST  -  . 106) . 0/ . 075)  ♦  .1 

For  new  drill  equation  (2)  converts  the  scaled  output  values 
to  total  inches,  equation  (3)  is  for  reground  conventional  point 
drills,  and  equation  (4)  is  for  reground  four  facet  drills. 

(2)  ACTUAL  =  MINIMUM  ACTUAL  VALUE  *  (SCALED  FORECAST 
- . 1 ) RANGE/ . 8 

=  139.5  *  (SCALED  FORECAST  -  .1)334. 8/. 8 

(3)  =  03  +  (SCALED  FORECAST  -  .1)260. 4/. 8 

(4)  =  102.3  ♦  (SCALED  FORECAST  -  .1)353. 4/. 8 
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The  following  conditions  also  were  applied  to  the  forecast 
for  new  drills  the  conditions  are:  if  the  forecast  is  less  than 

139.4  inches  set  the  forecast  to  139.4;  if  the  forecast  is 
greater  than  474.3  inches  set  the  forecast  to  474.3  inches.  For 
reground  conventional  grind  drills  the  conditions  are:  if  the 
forecast  is  less  than  93  inches  set  the  forecast  at  93  inches;  if 
the  forecast  is  greater  than  353.4  inches  set  the  forecast  at 

353.4  inches.  For  reground  four  facet  grind  drills  the 
conditions:  if  the  forecast  is  less  than  102.3  inches  set  the 
forecast  at  102.3;  if  the  forecast  is  greater  than  455.7  inches 
set  the  forecast  at  455.7. 


The  first  attempts  at  developing  a  neural  network  with  the 
capability  to  forecast  tool  life  centered  around  using  static 
parameter  values  to  define  the  problem;  point  angle,  relief 
angle,  chisel  edge  length,  web  thickness,  ratio.  Predicting 
performance  based  on  these  parameters  would  have  made  the  problem 
trivial.  However,  the  network  did  not  perform.  The  values  for 
the  first  workpiece  for  specific  energy  thrust  were  added  to 
further  define  the  problem.  Then  the  thrust  or  specific  energy 
values  for  the  first  five  workpieces  were  added  to  the  static 
variables.  These  attempts  proved  fruitless.  The  use  of  static 
variables  was  discontinued  and  focus  was  placed  on  using  thrust 
and  specific  energy  and  variations  such  as  smoothed  values  and 
first  difference  values.  The  final  decision  was  to  use  average 
thrustvalues  for  the  first  9  workpieces  as  the  independent 
variables.  But  even  here  the  network  did  not  achieve  the  goal  of 
a  forecast  with.n  plus  or  minus  two  w.  ^(pieces  when  challenged 
with  unknown  drill  data.  However,  this  might  be  the  result  of 
not  enough  training  examples,  only  21  drills  from  one 
manufacturer  and  2  drills  from  another  manufacturer  were 
available  for  the  new  drill  set.  However,  the  networks  could 
learn  to  differentiate  the  drills  in  the  training  set  even  though 
the  drills  were  treated  and  untreated. 


The  difference  in  manufacturers  was  tested.  This  wa^ 
accomplished  by  training  the  network  with  drills  from  one 
manufacturer  and  testing  it  with  drills  from  the  other.  In  most 
cases  the  forecasting  error  was  very  large.  However,  when  the 
drills  were  mixed  within  the  training  set  and  the  network  was 
challenged  with  the  training  set  the  addition  of  the  alien  drills 
did  not  impact  the  accuracy  of  the  network  with  respect  to  the 
other  drills.  It  seems  that  the  network  was  able  to  accommodate 
the  two  different  manufacturers. 


A  few  of  the  reground  drills  were  also  recoated  with  Titanium 
Nitride,  it  was  postulated  that  this  would  allow  them  to  perform 
as  a  new  drill.  This  was  tested  by  training  a  network  with 

new  drills  and  then  challenging  the  trained  network  with  these 
reground  recoated  drills.  The  forecasting  error  was  equivalent 
to  those  drills  that  were  just  reground.  The  regrinding 
recoating  process  does  no«,  result  in  a  new  drill.  It  results  in  a 
better  performing  reground  drill.  A  network  trained  on  new 
drills  cannot  be  used  to  forecast  reground  drills  and  networks 
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train«d  on  reground 
For  reground  drills 
the  grind  has  to  be 
grind  drills  cannot 
vice-versa . 


drills  cannot  be  used  to  forecast  new  drills, 
and  probably  new  drills 

the  same.  A  network  trained  on  conventional 
be  used  to  forecast  four  facet  drills  and 


Even  though  the  network  did  not  achieve  the  goal  of 
forecasting  unknown  challenge  drills  within  plus  or  minus  two 
workpieces,  the  forecasting  error  decreased  as  the  number  of 
examples  in  the  training  set  Increased.  This  indicates  that  the 
number  of  training  set  examples  is  not  sufficient. 


6.  C0HCLU8Z0H8: 


a.  Utilization  of  neural  networks  to  forecast  twist  drill 
lifetime  is  feasible. 


b.  As  the  investigations  into  different  manufacturers 
indicate  the  forecasting  capability  might  not  be  applicable  to 
the  general  situation.  The  forecasting  capability  would  be 
limited  to  a  specific  drill  workpiece  combination.  If  the  drill 
or  workpiece  is  changed  the  network  might  have  to  be  retrained. 

c.  The  best  improver  of  drill  performance  is  to  coat  the 
drills  with  Titanium  Nitride. 

d.  Average  thrust  values  are  the  chosen  method  for  problem 
definition. 


e.  Smoothing  average  thrust  values  or  specific  energy  values 
Increases  the  difficulty  of  training  a  neural  network. 

f.  First  difference  values  loses  more  of  the  information  and 
increases  the  difficulty  of  training  a  network. 


6.  RBC0IIIIENDATI0N8: 

a.  Continue  the  effort  to  develop  a  neural  network  capable 
of  forecasting  tool  life.  Incorporating  new  data  being  generated 
by  the  experimental  program. 

b.  Determine  if  the  forecasting  capability  is  only 
applicable  to  this  drill  workpiece  combination  or  can  it  be 
generalized  to  other  drills,  workpieces,  drill  workpiece 
combinations . 
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